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(54) Method for estimating and adjusting digital image contrast 

(57) A method of estimating the scene contrast from 
a digital image, the method comprises the steps of: 
forming a Laplacian histogram distribution; determining, 
from the Laplacian histogram, first and second thresh- 
olds which eliminate substantially uniform areas or a 
substantially textured portion of the digital image; 
selecting pixels which are based on the first and second 
thresholds from the digital image; forming a histogram 
from the sampled pixels; computing a standard devia- 
tion of the sampled histogram; and estimating contrast 
of the digital image by comparing the computed stand- 
ard deviation with a predetermined contrast for deter- 
mining contrast of the input image in relationship with 
the predetermined contrast. 
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Description 

The present invention relates to digital imaging processing and, more particularly, to a method for estimating and 
thereafter adjusting contrast of a digital image. 

5 

Appendix 

The disclosure in the appendix of this patent document contains material to which a claim of copyright protection is 
made. The copyright owner has no objection to the facsimile reproduction of any one of the patent documents or the 
10 patent disclosure, as it appears in the U.S. Patent and Trademark Office patent file or records, but reserves all other 
rights whatsoever. 

A typical digital imaging system captures an image and, after various automatic or interactive manipulations, dis- 
plays the image on a monitor or prints a hardcopy of the image both for permitting human visual viewing. The perceived 
contrast of the printed or displayed image, as a pleasing reproduction of the original scene contrast, depends mainly on 

15 two factors: the scene contrast and the system reproduction contrast. 

The scene contrast is affected by the scene illumination (the lighting contrast), the distribution of object reflectance 
factors (the object contrast), and the distribution of object color (the color contrast) . 

The system reproduction contrast is determined by the various steps along the imaging chain, such as sensor cal- 
ibration, tone scale mapping, and output device characteristics. In order to achieve automatic contrast adjustment in 

20 digital photofinishing, one needs a method for estimating the scene contrast, and based on this estimate, a method for 
adjusting the reproduced image contrast or system contrast for optimal visual reproduction. 

US-A-4,731 ,671 teaches a method for contrast adjustment in digital image processing. This method creates a plu- 
rality of predetermined Laplacian response intervals and then computes the Laplacian for each pixel in an input image. 
The code value for each pixel in the image is then placed in its corresponding Laplacian response interval for accumu- 

25 lating several code value histograms, one for each Laplacian response interval. It then selects the histogram whose 
shape is closest to a normal distribution The standard deviation of the selected histogram is taken as an estimate of the 
scene contrast. The standard deviation is used as an estimate of the scene contrast because of the correlation between 
the standard deviation and the scene contrast. That is, a high standard deviation corresponds to a high scene contrast 
and a low standard deviation corresponds to a low scene contrast. 

30 The estimated contrast is then compared with a distribution of scene contrasts (that is, standard deviations from a 
plurality of scenes) pre-computed from a plurality of random sample of images. If the estimated contrast is higher than 
the population average, then the image is considered to have a higher than normal contrast and the system reproduc- 
tion contrast is then adjusted lower so that the printed image will have an image contrast that is closer to the average 
contrast. If the estimated image contrast is lower than the average, then the system reproduction contrast is raised 

35 accordingly. 

There are also methods for contrast adjustment that are based on histogram transformation. This class of methods 
does not explicitly estimate the scene contrast in the input image. The method simply assumes that an image histogram 
has to be in a certain shape and proceeds to transform it into the desired shape. The best known example is the histo- 
gram equalization method. 

40 Still further, a theoretical construct is described by W. A. Richards, "Lightness Scale From Image Intensity Distribu- 
tion," Applied Optics, 21,14, pp. 2569-2582, 1982. The idea is that a "randomly" sampled log-exposure histogram of an 
image should have a shape similar to a normal distribution. 

Although the presently known and utilized methods for adjusting tone scale in a digital image are satisfactory, they 
are not without drawbacks. The method of US-A-4,654,722 seems to perform rather well for most images; however, 

45 there are a few situations when there are shortcomings. First, there are two parameters that have to be predetermined: 
the lower threshold and the width of the Laplacian interval. The patent does not provide an automatic method for setting 
these two parameters. As a consequence, for some images, the lower threshold is not high enough to exclude noise 
and textures, therefore, causing the standard deviation of the selected histogram to be unduly biased by large uniform 
areas (when the noise is higher than the lower threshold) or by busy texture areas (such as grass or trees). Secondly, 

so the selected histogram often exhibits bimodality for overcast scenes with sky in them. Although the scene contrast is 
low, the standard deviation of the selected histogram is large because of the bimodality caused by the dark grass pixels 
and the bright sky pixels. 

In addition, the above-described histogram transformation method does not have a sound theoretical foundation, 
and frequently, it produces unacceptable tone reproduction for consumer images. Still further, in the method of W. A. 
55 Richards, a drawback arises in defining what constitutes a truly random sampling. Furthermore, another drawback of 
the histogram modification approach in the prior art is that the resulting tone transformation curve often has too high or 
too low local contrast in some portions of the curve. Therefore, the processed image does not look pleasing. 

Consequently, a need exists for an improved method for estimating the scene contrast and adjusting the reproduc- 
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tion contrast based on this estimated scene contrast. 

From the above discussion, there are three shortcomings in the prior art for image contrast estimation and adjust- 
ment: (1) large uniform areas can produce a bias on the contrast estimate, calculated over the entire image; (2) busy 
texture areas can produce a bias on the contrast estimate, calculated only on the edge pixels; and (3) contrast adjust- 

5 ment needs to be performed under constrained limits. In the present invention, a method of detecting the uniform areas 
and the busy texture areas in the input image is developed to solve the first two shortcomings and a method of con- 
structing the final reproduction tone transformation curve within pre-specrf ied contrast limits is used for adjusting the 
image contrast. A further advantage of this invention is that instead of transforming every image histogram into a fixed- 
shaped target histogram, such as a normal distribution, the present invention generates an image-dependent target his- 

io togram tor each image. This greatly reduces the algorithm's sensitivity to sampling error. 

In this invention, the method for estimating the scene contrast from a digital image is to sample only those high con- 
trast pixels in the image and calculate the standard deviation of their log-exposure distribution. The computed standard 
deviation is taken as a measure of the scene contrast, which is used to compare with similarly calculated statistics from 
a large population of consumer images. If an input scene contrast is lower than the mean contrast of the precompiled 

75 population scene contrasts, then the contrast of the input image will be adjusted higher. If the input scene contrast is 
higher than the population mean contrast, then the input image contrast is slightly reduced. 

In the present invention, the contrast adjustment is accomplished through a process commonly known as histo- 
gram modification. The original histogram is mapped (and thus modified) through a tone transformation curve into the 
target histogram. The present invention includes (1) a target histogram whose shape is derived from and therefore 

20 dependent on the original histogram computed from the input image. (2) a tone transformation curve that is constrained 
to have local slopes between the pre-imposed lower and upper bounds, and (3) a tone transformation curve that 
includes a fixed point in mid-tone range that maps a certain input code to the output code of the same value. In the pre- 
ferred embodiment of the invention, this fixed point corresponds to the median of the input histogram and that of the 
output target histogram. Alternatively, this fixed point can be chosen by the users to maintain the desired white balance 

25 of the image. 

Fig. 1 is a diagram illustrating a typical system for implementing the present invention; 
Fig. 2 illustrates a flowchart of a software program of the present invention; 

Fig. 3 illustrates in detail a portion of the software program and, more specifically, the procedure for estimating the 
30 scene contrast; 

Fig. 4 illustrates in detail a portion of the software program and, more specifically, the procedure for determining 
thresholds in pixel sampling; 

Fig. 5 illustrates an example of a typical Laplacian histogram, hist(L), of an image; 

Fig. 6 illustrates the locations of the lower and upper thresholds as determined from the Laplacian histogram, 
35 hist(L), of Fig. 5; 

Fig. 7 illustrates in detail a portion of the software program and, more specifically, sampling pixels from the original 
image; 

Fig. 8 in detail a portion of the software program and, more specifically, the procedure for constructing the contrast- 
adjusted tone scale curve for the luminance signal; 
40 Fig. 9 illustrates the function that is used to determine the standard deviation of the target histogram from the stand- 
ard deviation of the input histogram; and 

Fig. 10 illustrates the construction of the tone transformation curve y(x) from the input histogram K(x) and the target 
histogram Q(y). 

45 In the below-described preferred embodiment, the computer readable storage medium may comprise, for example; 
magnetic storage media such as a magnetic disc (such as a floppy disc) or magnetic tape; optical storage media such 
as an optical disc, optical tape, or machine readable bar code; solid state electronic storage devices such as read only 
memory (ROM), or random access memory (RAM); or any other physical device or medium employed to store a com- 
puter program. 

so Referring to Fig. 1 , there is illustrated a typical general purpose computer system 5 for implementing the software 
program of the present invention. The software program may be installed for execution on the general purpose compu- 
ter system 5 via any suitable computer readable storage medium 10. as is well known in the art. 

A captured image 20 is input into the general purpose computer 5 via any well known means, such as a scanner 
30, where it is digitized and preferably converted into a red, green and blue (RGB) digital image format. The digitized 

55 image is transmitted to a central processing unit 40 where it is processed by the software program of the present inven- 
tion. The digitized image is also preferably calibrated in log-exposure metric by the central processing unit 40; such cal- 
ibration into log-exposure metric is well known in the art. The digitized image may also be displayed on a monitor 50 
during or after processing. 
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Referring to Fig. 2, there is illustrated an overview of the software program of the present invention for estimating 
the input scene contrast and adjusting the output image contrast automatically. The software program is initiated S10, 
and the digital image is first processed with any well known color and density balance algorithm S20 to correct for color 
cast due to illumination and for exposure variation due to errors in the camera exposure control. The function of the 
5 color and density balance algorithm is for adjusting the red, green, and blue records of the input image so that some 
chosen digital code values are printed (or displayed) to a medium gray in the output media. For example, the digital 
code values (R,G,B) = (2000, 2000, 2000) are printed on the output photographic paper at status A densities (0.8, 0.8, 
0.8). 

After the image has been color and density balanced, any well known color transform is applied S30 to the bal- 
io anced image so that the RGB signal is transformed into any suitable color space that has one (luminance) component 
representing the lightness variation and two (chrominance) components representing the chromatic variation in the 
image. The following color space is preferred: 



15 



Luminance: CI=(R+G+B)/^3 
Chrominance: Cs=(R-B)/V2 
Chrominance: Ct=(2G-R-B)/V6 

20 where R,G, B are the red, green, and blue log-exposures, although any other perception based space may also be used, 
such as CIELAB. It is instructive to note that in the present invention the contrast of the luminance component is 
adjusted independently from that of the chrominance component. 

Next, the scene contrast is estimated S40 from the luminance component of the input image, as will be described 
in detail below in reference to Fig. 3. A tone scale curve is then constructed S50 from the estimated scene contrast, and 

25 the luminance image is then mapped S60 through the tone scale curve for adjusting the tone scale, as will also be 
described in detail below. The program may then be exited S70, and the digital image printed after the luminance image 
has been properly combined with the chrominance images by the following inverse transform: 
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R=ClH3+CsH2-CtH6 

G=ClH3+2CtHS 
B=ClN3-CsH2-CtH6 

35 . Alternatively, the results of the program may be further processed by other well known image processing programs for 
further processing the image. 

Referring to Fig. 3, there is illustrated the step of estimating the scene contrast S40. First, two thresholds (the lower 
and the upper thresholds) are determined S80 for a Laplacian response, as will be illustrated in detail in Fig. 4. Then, 
the two thresholds are used in deciding which pixels should be sampled from the digital image for further analysis in 

40 eventually determining the tone scale curve. A histogram K(x) derived from the sampled pixels is created S100 and its 
standard deviation (k) is calculated S1 1 0, where x denotes the input code value. The output k is used as an estimate of 
the scene contrast. Output k is used as an estimate of the standard deviation because of the previously stated correla- 
tion between the standard deviation and the scene contrast. 

Referring to Fig. 4, there are illustrated the details of the step for determining the thresholds S80. The well known 

45 Laplacian operator is applied S120 to the input luminance image and the Laplacian response, L, for each pixel is cal- 
culated S130 to form the Laplacian histogram, hist(L). A typical Laplacian kernel is illustrated in block S120, although 
any Laplacian kernel may be used, (see The Image Processing Handbook. Second Edition, pages 225-232, for further 
discussion) 

The Laplacian histogram, hist(L), can be well approximated by a mixture model: 
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h(L) = 



where 0 ^ a < 1 , a is the standard deviation of the Gaussian component, and A, is the decay constant of the double- 
exponential component. Since the first term represents pixels from uniform and texture areas, the thresholds should be 
selected at substantially ±2a to ±3a. It is possible to determine the parameter a from a least square fit of the model, but 
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a more efficient approximation is to take the second derivative of hist(L) S140, and find the local maxima along the neg- 
ative and the positive axis, as described in detail below. 

Mathematically, we want to locate zeroes in the third derivative: 

dL 3 Jznv* a 2 2X A 

10 For consumer images, a is much smaller than X, and the zeroes are approximately located at d 1 * --73a and 
d 2 « + JZo . Therefore, in the preferred embodiment of the invention, the thresholds, t-j and t 2 , are selected S145 at 
1 1 =f(d 1 )=1.5d 1 and t 2 =f(d 2 )=1 .5d 2 , that is at approximately ±2.6a, which will exclude 99% of all the pixels from the 
uniform and texture areas and will exclude 99% of the pixels containing noise. 

Fig. 5 illustrates an example of the Laplacian histogram of a consumer image. The circles are the data points, the 

is thick solid curve is the mixture model, and the two thin, dashed curves are the two components of the mixture model. 
Fig. 6 depicts where the lower and the upper thresholds, t t and t 2 , are located by the method of maximal second deriv- 
ative. 

After the two thresholds are determined, Fig. 7 illustrates how the pixels are sampled and the histogram K(x) is 
computed S100. For each pixel with a code value (x) in the input image S150, its Laplacian value is computed S160. If 

20 its Laplacian value is greater than the upper threshold or less than the lower threshold S1 70, then the pixel is retrieved 
or sampled and the histogram K(x) is incremented St 80 by 1 at code value x. This sampling and incrementing is 
repeated for the entire image S190. After the calculation of the histogram K(x) is completed, the standard deviation, k, 
of K(x) is then computed as an estimate of the scene contrast. 

Referring to Fig. 8, once the scene contrast estimate, k, is computed, the tone scale is computed S50. First, a target 

25 histogram, Q(y), is computed and thereafter the desired tone transformation curve y(x) using a finite-difference step- 
wise construction procedure is constructed, where y denotes the output code value. 

The target histogram, Q(y). is computed by convolving the sample histogram K(y) with a Gaussian distribution G(y). 
and then by scaling the resulting function with a scaling factor, s. The standard deviation g of G(y) determines the shape 
of the target function, rf g » k, then the target function Q(y) is essentially a Gaussian distribution. In this case, the tone 

30 transformation curve, y(x), will map K(x) to a Gaussian distribution. If g « k, then the target function Q(y) will have 
essentially the same shape as K(x). In this case, the tone transformation curve, y(x), is essentially a straight line. Its 
slope determines the global contrast adjustment. Therefore, the single parameter, g, allows the user to control the 
desired manipulation of the characteristics of the tone transformation curve. In the general case, g is adjusted according 
to the shape parameters of the histogram K(x) by a function p(k) S1 80. It is instructive to note that other factors may be 

35 used as arguments of p(k) in the determination of g. For example, rf the skewness of K(x) is large, the value of g can be 
made small, so that the target histogram, Q(y), also has a large skewness. In the simplest implementation, g is made 
to be a function, p(k), of the scene contrast estimate, k, alone. Experimental results show that a simple function, 
g=p(k)=k is sufficient to produce very pleasing images. Once the standard deviation g is determined, the function G 
can be constructed Si 90. This choice of g=k produces a target function Q(y) that is halfway between K(x) and a Gaus- 

40 sian distribution as a result of the convolution of K(y) and G(y) S200. 

The variance of the convolution product, F(y), of K(y) and G(y) is the sum of the variances of K(y) and G(y), that is, 
k 2 + g 2 . Consequently, F(y) has a wider spread than the input sampled histogram K(x). If the goal is only to change the 
shape, but not the spread, of the histogram, then F(y) has to be scaled down back to the same variance as that of K(x). 
However, the goal of digital printing is to adjust the image contrast to produce a pleasing reproduction of the input 

45 image. This is achieved by adjusting the standard deviation, c, of the target histogram. For this purpose, a scaling factor 
S210, 
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g g 

is used to control the final spread of the target function, Q(y). It is used to scale the convolution product, F(y), to get 
Q(y): 

Q <y> = i F <i>- 
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Referring to Fig. 9, the standard deviation, c. of the target histogram Q(y), is determined from a function u of the stand- 
ard deviation of the input histogram K(x). If c = k , then the target function Q(y) will have the same standard deviation 
as K(x), resulting in no adjustment of global contrast If c is chosen to be greater than k, then the global contrast will be 
increased. Therefore, if we make c a function of K that is, c=u(k) S205, then we can adaptively adjust the global contrast 
of the input image. For example, if k is smaller than the population mean contrast, ko, then we should make c greater 
than k and thereby increase the image contrast. In the preferred embodiment of this invention, the function c=u(k) is 
implemented as a one-dimensional lookup table with the following functional form: c =k 0 (l-exp[-k/k 1 ]+exp[-k 0 /k 1 ]) , 
when k < ko, and c=k 0 +b*(k-k 0 ) , when k > ko, where ko, k 1 and b are constants determined from population statistics. 

Referring to Fig. 8 and 9, they illustrate the construction of the tone transformation curve y(x) from the input histo- 
gram K(x) and the target histogram Q(y). The procedure to construct the curve y(x) that maps one histogram, K(x), to 
another histogram, Q(y), is defined by the following equation: 

y x 
jQ(4)d4= jKWdti. 



Taking derivative on both sides, we have: Q(y)dy = K(x)dx , which can be solved by a finite-difference method with a 
boundary condition. Since the color and density balanced input image has a defined balanced point, say xq. which is 
usually the point that will be mapped to the medium gray at the output, we can set the boundary condition of y(x) so that 
y o =v ( x o) =x o ■ T"' 5 boundary condition requires that the target distribution Q(y) be translated along the y axis so that 

y =x o x o 

J Q(«d4= jK^Jdr,. 



Therefore, the density balanced point is not changed by the tone transformation curve. However, if the output image is 
to be re-balanced again, then the particular selection of the boundary condition is not very important. Defining the slope 
function of y(x) f S(x,y) = K(x)/Q(y) , the finite-difference solution of y as a function of x is given S220 by: 

y(x 1+i )=y(x jJ+SfXj.yfx i))(x 1+i -x j), 

starting with y(x ^ )=y(x 0 )+S(x 0 ,y(x 0 ))(x 1 -x 0 ) where y(x 0 )=x 0 . 

The tone transformation curve so constructed may not be very smooth because of the discrete implementation in 
digital computers. In order to get a smooth curve, it may be desirable to smooth the curve by a low-pass filter S230, such 
as a Gaussian filter. The finite-difference method of constructing the tone transformation curve provides an easy way to 
impose the limits, MAXIMUM SLOPE and MINIMUM SLOPE, on the instantaneous slope S(x i ,y(x i )). If at any step, the 
slope S(x jf y(Xj)) exceeds the limits, then its value is clipped at the limits. Therefore, the resulting tone transformation 
curve is guaranteed to have its slope vary within the specified limits. This is a very important property of a good, prac- 
tical tone transformation. 

Other features of the invention are included below. 

The method further comprising the step of computing a tone scale transformation curve from the estimate contrast 
of the digital image. 

The method further comprising the step of constructing the tone transformation curve by modifying the histogram 
formed from the sampled pixels so that a target histogram is generated which the target histogram is dependent on the 
digital image. 

The method further comprising the step of constructing a tone transformation curve by convolving the sampled 
pixel histogram with another pre-defined function with image-dependent parameters. 
The method wherein the pre-defined function is a Gaussian distribution. 

The method further comprising forming a target histogram from the sampled histogram by convolving the sampled 
histogram with a predefined function, and constructing a tone scale curve by transforming the sampled histogram to 
the target histogram. 

The method wherein the step of determining the first and second thresholds includes finding a local maxima of a 
second derivative of the Laplacian histogram. 

The method wherein the step of selecting the pixels includes selecting the pixels that exceed substantially the first 
threshold. 

The method wherein the step of selecting the pixels includes selecting the pixels that are less than substantially the 
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second threshold. 

The method further comprising the step of computing a standard deviation of the sampled histogram and estimat- 
ing contrast of the digital image by comparing the computed standard deviation with a predetermined contrast for deter- 
mining contrast of the input image in relationship with the predetermined contrast. 
5 The method wherein the step of determining the first and second thresholds includes finding a local maxima of a 

second derivative of the Laplacian histogram. 

The method wherein the step of selecting the pixels includes selecting the pixels that exceed substantially the first 
threshold. 

The method wherein the step of selecting the pixels includes selecting the pixels that are less than substantially the 
10 second threshold. 

The method further comprising the step of constructing the tone transformation curve by modifying the histogram 
formed from the sampled pixels so that an image-dependent target histogram is generated. 
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Claims 

1 - A method of estimating the scene contrast from a digital image, the method comprising the steps of: 

a) forming a Laplacian histogram distribution; 

b) determining, from the Laplacian histogram, first and second thresholds which eliminate substantially uniform 
areas or substantially textured portion of the digital image; 

c) selecting pixels which are based on the first and second thresholds from the digital image; 

d) forming a histogram from the sampled pixels; 

e) computing a standard deviation of the sampled histogram; and 

f) estimating contrast of the digital image by comparing the computed standard deviation with a predetermined 
contrast for determining contrast of the input image in relationship with the predetermined contrast. 

2. The method of claim 1, wherein the step of determining the first and second thresholds includes finding a local 
maxima of a second derivative of the Laplacian histogram. 

3. The method of claim 1 , wherein the step of selecting the pixels includes selecting the pixels that exceed substan- 
tially the first threshold. 

4. The method of claim 1 , wherein the step of selecting the pixels includes selecting the pixels that are less than sub- 
stantially the second threshold. 

5. A method of estimating the scene contrast from a digital image, the method comprising the steps of: 

a) forming a Laplacian histogram distribution; 

b) determining, from the Laplacian histogram, first and second thresholds; 

c) selecting pixels which are based on the first and second thresholds from the digital image; 

d) forming a histogram from the sampled pixels; 

e) forming a target histogram from the sampled histogram by convolving the sampled histogram with a pre- 
defined function; and 

f) constructing a tone scale curve by transforming the sampled histogram to the target histogram. 

6. The method as in claim 1 3, wherein the step of forming a target histogram includes convolving the sampled histo- 
gram with a Gaussian distribution. 

7. The method as in claim 14, wherein the step of forming a target histogram includes convolving the sampled histo- 
gram with the Gaussian distribution having a standard deviation substantially the same as the sampled histogram: 

8. A f inrte-drfference method for constructing a transformation curve, y(x) that maps an input histogram K(x) to an out- 
put target histogram Q(y), so that the instantaneous slope of the curve is within specified limits, the method com- 
prising the steps of: 

a) choosing a fixed point (xq, yo) where xq corresponds to a predetermined percentile of the input histogram 
K(x) and y 0 corresponds to the same predetermined percentile of the output target histogram Q(y); 

b) defining a slope function, S(x,y), as the ratio of the input histogram K(x), to that of the target histogram Q(y); 
and 

c) computing the transformation curve, step by step, for N points on the input histogram, x jp i= 1 to N, using the 
equation: y( Xi+1 ) = y(x j) + S^y^)) ( Xj+1 -Xj), starting with y(x ,) = y(x 0 ) + S(x 0 , y(x 0 )) (x , -x 0 ) where 
y( x o) =x o : a* eacn ste P- tne value of the slope function, S(Xj,y(xj)) is maintained between the specified limits. 

9. A method for excluding pixels from a uniform portion or a texture portion of a digital image, comprising the steps of: 

a) forming a Laplacian histogram distribution; 

b) determining, from the Laplacian histogram, first and second thresholds which eliminate substantially the uni- 
form portion or substantially the textured portion of the digital image; and 

c) selecting pixels which are based on the first and second thresholds from the digital image. 

10. The method of claim 22, wherein the step of determining the first and second thresholds includes finding a local 
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maxima of a second derivative of the Laplacian histogram. 
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